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ABSTRACT 

To obtain from students information for normative 
evaluation of instruction, course-specific questionnaires were 
developed with individual faculty. Forms were introduced by a 
statement that the purpose of evaluation was to improve instruction. 
Although items varied with the course, all had potential action 
implications and all requested recommendations for change. Results 
supporting the effectiveness of course-specific evaluation are 
reported. Information derived instigated responsive faculty action. 
Several instructional research projects have been initiated. In both 
courses in which forms were administered during consecutive years, 
statistically significant improvement was shown for items related to 
changes introduced but not for other items. (Author) 
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When teachers evaluate student performance, it is accepted 
that specific identification of strengths and weaknesses more than 
a letter grade will guide the student's efforts to do better the 

next tijne7 The same principle should apply wh^n~telchel^~^ 

students about their own performance for the purpose of effecting 
positive change. Nevertheless, most course evaluation is accom- 
plished through the use of forms comprised of items that apply 
across virtually all disciplines and all types of courses. From 
students' responses to these questionnaires one derives mean ratings 
on attributes such as value of readings, clarity of objectives and 
..value of the course as a whole. These ratings may serve to elate 
or depress instructors, to influence administrative action (rarely) 
and, if the results are made available publicly, to influence the 
exercise of student option. They are probably less useful for 
formative evaluation. 

This paper describes one effort to develop effective instru- 
ments for formative evaluation. The viability of the method is 
assessed by three criteria: (1) the generation of information with 
direct implications for instructional change; (2) the initiation 
of cooperative projects which have general applicability for in- 
structional improvement and (3)- the improvement of ratings result- 
ing from responsive faculty action. 
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In an effort to reach the goals listed above, general evalua- 
tion forms had been made available to faculty. On the basis of 
mean scores and frequency distributions, reports were prepared. 
Recommendations consisted of little more than exhortations to im- 
prove whatever attributes students rated low. We could provide 
nothing more than a phenotypic diagnosis a*nd could prescribe no 
treatment. There was no ^;ay_to^derive from student ratings deter- 
minants of. poor ratings or actions that might be expected to have 
a salutary effect. Evaluations may have reassured or discouraged 
faculty but there was no evidence whatever for the improvement of 
instruction. No teacher reported that changes had been suggested 
by evaluations or had initiated an instructional project. 

Last year we began to develop, in cooperation with individual 
faculty, evaluation forms designed to have clear action implica- 
tions within their courses. Although, by intent, items varied from 
course to course, all were designed to lead to instructional change 
and. all asked students themselves to recommend specific changes. 
Forms were prefaced with a statement that the purpose of evaluation 
was to improve instruction and that recommendations would be care- 
fully considered by faculty. The intent of this statement was not 
only to engage the best efforts of students but also formally to 
commit faculty to positive action. Items included questions per- 
taining to the appropriateness and realization of each course ob- 
jective, and methods used to attain and evaluate the accomplishment 
of each objective. Critical incident items asking for description c 
situations in which a teacher did something especially helpful or 
detrimental to student learning were frequently used. 
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The immediately apparent advantage of course-specific evalua- 
tions was the rich supply of information offered for diagnosis of 
course problems and prescribed treatment. Furthermore, reports gen- 
erated responsive faculty action. To cite one example, in a practice 
management, course students rated the relevance of each project to 
dental practice and stated information and sikills they wished toj 
acquire^.. Most projects aette- Pa^ed-Tow and new skills and inform!^ 
tion were identified. The instructor eliminated projects, scheduled 
lecturers from other disciplines and is developing criterion tests 
and instructional materials simulating decision making in private 
practice. 

A second effect has been the initiation of instructional pro- 
jects. Students' complaints about faculty inconsistency in evalua- 
ting performance has led to a project to improve inter- judge reli- 
ability. Posit: ve response to sequential models of technic products 
and the judgment that performance would be. improved if poor as well- 
as good examples were provided has motivated a project in discrimina- 
tion learning. Descriptions of positive and negative critical in- 
cidents in clinical instruction has led to the production of video- 
taped critical incidents for faculty training. 

Course-specific evaluation has been used in consecutive years 
in two courses. In a technics course, student-faculty rapport was 
rated low. Additional data showed that two-thirds of students rated 
faculty availability one or two 'on a five point scale and critical 
incident reports emphasized long waits at check points and hostile, 
uninformative faculty evaluation. Several recommendations were made 
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but the most obvious problem was that students were frustrated by 
low faculty availability and faculty overburdened by excessive de- 
mands. The course director presented findings to administration and 
secured additional staff. The following year less than a quarter 
of students rated faculty availability at one or two. More impor- 
tantly, student-faculty rapport and over -all cours e evaluation im- 
proved significantly (t test) while ratings of attributes not treated 
(e.g. value of readings) did not change. In a course in dental 
hygiene critical incident data and responses to other questions re- 
vealed problems in consistency among instructors in recommended pro- 
cedures and evaluation. The course director developed videotapes 
demonstrating procedures and supplied faculty and students with 
statements of objectives and assessment instruments. The following 
year, statistically significant *(t test) improvement was shown in 
questions concerning staff preparation, flexibility, knowledge and 
enthusiasm but not in attributes unrelated to changes introduced. 

We have found course-specific evaluation effective for formative 
evaluation. One gain has been the universal faculty response of: 
"If I know how to improve my course, I will" and action affirming 
that statement. Many student recommendations are clear applications 
of principles. of learning and instruction which, perhaps paradoxically, 
gain credence by being offered by students. Several faculty inde- 
pendently requested that students be apprised of recommendations acted 
upon by faculty. This feedback, now instituted as an integral part 
of the evaluation- process, should encourage the continued best effort 
of students as critics of their own instruction and contributors to 
positive instructional change. 



